Skip to main content

Reply to this post | Go Back
View Post [edit]

Poster: compn Date: Nov 29, 2011 5:11am
Forum: web Subject: robots.txt timed out!

http://wayback.archive.org/web/*/http://x-chromosome.com/*

any chance i can see whats archived?

this robots.txt stuff is killing me. first it was the domain squatters robots.txt disallowing *. now this.

well at least i found a workaround for this.

This post was modified by compn on 2011-11-29 13:11:59

Reply to this post
Reply [edit]

Poster: gyanarthi Date: Dec 27, 2011 4:19pm
Forum: web Subject: Re: robots.txt timed out!

I still get "We were unable to get the robots.txt document to display this page. Our request Timed Out."
for the page you listed (and for my whoseflorida.com) - what kind of "workaround "did you find?